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Abstract 

We present computational and analytical results indicating that sys- 
tems of driven entities with repulsive interactions tend to reach an opti- 
mal state associated with minimal interaction and minimal dissipation. 
Using concepts related to those from non-equilibrium thermodynamics 
as well as game theoretical ideas, we generalize this finding to an even 
wider class of self-organizing systems which have the ability to reach a 
state of maximal overall "success" . This principle is expected to be rel- 
evant for driven systems in physics like sheared granular media, but it 
is also applicable to biological, social, and economic systems, for which 
only a limited number of quantitative principles are available yet. 
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1 Introduction 

Extremal principles are fundamental in our interpretation of phenomena in nature. 
One of the best known examples is the second law of thermodynamics [1-3], gov- 
erning most physical and chemical systems and stating the continuous increase of 
entropy ("disorder") in closed systems. Most systems in our natural environment, 
however, are open, which is true for driven physical systems, but even more for 
biological, economic, and social systems. As a consequence, these systems are usu- 
ally characterized by self-organized structures [2-36], which calls for principles that 
apply on time scales shorter or comparable to the life spans of these systems. For 
example, it is known that in growth and aggregation processes it is usually the most 
unstable mode that determines the finally evolving structure. Hence, there exists 
an extremum principle of fastest propagation, which is applicable to so apparently 
different phenomena like crystall growth on the one hand [37] and pattern formation 
in bacterial colonies on the other hand [38] . 

Recent simulations point to the possible existence of additional optimality principles 
in certain kinds of driven multi-particle or multi-agent systems. As examples we 
mention 

1. lane formation in pedestrian crowds [33] (sec Fig. 1), which appears to be 
similar to the size segregation in sheared granular media [34], 

2. the self-organization of coherent motion in a mixture of cars and trucks [35] 
(see Fig. 2), and 

3. the evolution of trail systems [36] (see Fig. 3). 

In these systems, the respective interacting entities (pedestrians, driver- vehicle units, 

or particles) have to coordinate each other in order to reach a system state which 
is "favourable" to them. It was conjectured [36, 35] that the resulting system states 
are optimal in some sense, but there are many open questions to be addressed: 

1. Is there really a quantity which is optimized by the self-organizing system in 
the course of time? 

2. If yes, which quantity is it? Is there a systematic way to derive it? 

3. What are the conditions for the existence of such a quantity? 

4. Is there any systematic connection between self-organization and optimiza- 
tion? 

5. If optimal self-organized systems exist at all, are they exceptional or quite 
common? 
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We will address these questions in the following sections. A particular problem will 
be, how to formulate the theoretical approach to the problem general enough to 
grasp the variety of different systems mentioned above. We will manage this by 
applying concepts related to those from thermodynamics [1-3, 6] as well as game 
theoretical ideas [6-9,39-46]. 



2 An Example: Lane Formation 

To illustrate the non-trivial aspects of optimal self-organization, let us consider 
the dynamics of pedestrian crowds. We begin with a system of oppositely moving 
pedestrians in a corridor, for which lane formation has been observed in empirical 
studies [47]. Readers who prefer an example from physics may instead imagine a long 
vertical column of a viscous fluid with light (rising) and heavy (sinking) particles of 
equal size (where we will assume that the absolute density difference of the particles 
with regard to the fluid is the same). In fact, we encourage the reader to do this 
new experiment. 

By Xa{t) we denote the position of pedestrian or particle a at time t, by Va{t) ~ 
dXa{t)/dt its velocity, by Vq its equilibrium speed in the absence of (interparticle) 
interactions, and by its "desired" or "preferred" direction of motion. Then, the 
equation mimicking pedestrian or describing particle motion reads 

Va{t) = VoCa + Yl f apidapit)) (1) 

(in the overdamped limit), fap represents repulsive interactions between pedestrians 
or particles a and /5, which were assumed to decrease monotonically with their 
distance dapit) = \\xa{t) — Xf^{t)\\. We will not specify the exact form of f^p, since 
it turns out to be quite irrelevant for the kind of phenomena we want to describe, 
here. The forces can be even chosen in a velocity-dependent way [47, 48] . 

In cases of two opposite desired directions of motion, simulations of the above model 
reproduce the formation of lanes of uniform walking directions observed for pedes- 
trians (see Fig. 1), while there are no stable self-organized states in cases of four 
different desired directions of motion (e.g., at intersections).^ It is clear that lane for- 
mation will maximize the average velocity in the respective desired walking direction 
and, therefore, the quantity 

E(t) = ^^""^ ' < 1 , (2) 

which is a measure of the "efficiency" or "success" of motion. (Here, {{■)a)t denotes 
the average over the pedestrians and over time.) Moreover, optimization of efficiency 

^The reader is invited to do his own simulation experiments with our Java Applets for lane 
formation and intersections available on this www-page: 
http : / / www . theo2 . physik . uni-stuttgart . de/helbing . html 
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immediately implies that the system minimizes the quantity 



■a 




Vo - {{Va ■ ea)a)t = "^0(1 " E) , 



(3) 



i.e., the average interaction intensity opposite to the respective desired direction of 
motion. 

Hence, even without the use of difficult mathematics we could show that the sys- 
tem minimizes the interaction intensity of the pedestrians (or particles), if it shows 
segregation into lanes of uniform directions of motion. Note, however, that lane for- 
mation is not a trivial effect, but eventually arises only due to the smaller relative 
velocity and interaction rate that pedestrians with the same walking direction have 
(see Section 3). In more detail, the mechanism of lane formation can be understood 
as follows: Pedestrians moving in a mixed crowd or moving against the stream will 
have frequent and strong interactions. In each interaction, the encountering pedes- 
trians move a little aside in order to pass each other. This sidewards movement tends 
to separate oppositely moving pedestrians. Moreover, once the pedestrians move in 
uniform lanes, they will have very rare and weak interactions. Hence, the tendency 
to break up existing lanes is negligible. Furthermore, the most stable configuration 
corresponds to a state with a minimal interaction rate. Therefore, lane formation 
and minimal interaction rate are two sides of the same medal. Nevertheless, lane for- 
mation does not occur in all driven repulsive systems. There are certain conditions 
for it, which we will work out later on (see Section 6). 



To give an analytical description of the macroscopic dynamics of the considered 
system, we will set up continuum equations for the pedestrian densities. By indexes a 
and b, we will distinguish different (sub-)populations defined by the different desired 
walking directions. For the mathematical description of lane formation, it is sufficient 
to focus on the one-dimensional dynamics perpendicular to the desired walking 
directions. (Imagine a projection of pedestrian dynamics on a cross section of the 
walkway). The distribution of the Na pedestrians of population a over the locations 
X of this one- dimensional space will be represented by the densities Pa{x,t) > 0. 

Assuming conservation of the number 



of pedestrians in each population a, where / denotes the spatial extension of the 
system, we obtain the so-called continuity equations [1] 



3 The Macroscopic Equation 




(4) 
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Here, Va{x, t) is the average velocity of pedestrians of population a perpendicular to 
their desired walking direction. In the following, we will give a rough estimate of this 
velocity: It will be proportional to the frequency z/^ of interactions that a pedestrian 
of population a encounters with other pedestrians. Also, it will be proportional 
to the average amount Ax that a pedestrian moves aside when evading another 
pedestrian. Finally, it will be proportional to the difference of the probabilities 
and p_ to move in positive or negative x-direction, respectively. In summary, we 
have the relation 

Va{x,t) ^ CUa,Ax{p+ - p_) . (6) 

With a prefactor c 1 like c{x, t) — [l^Y^a Pa {x, t) / Pmax] , one can take into account 
that the motion is slowed down in crowded areas. It also limits the local density to 
the maximum density pmax- 

The interaction rate of pedestrians belonging to (sub-) population a with others is 

= CaaPa + CabPb with tt, (7) 

where Cba > Caa because of the higher average relative velocity between oppositely 
moving pedestrians. (Although this inequality is enough to know for the following 
discussion, we mention that Caa = {D / I)x\/t^ and Cab = Cba ~ {D/I)x{va + 
Vb) [49]. Herein, D is the so-called "total cross section", which corresponds to the 
effective diameter of a pedestrian. The factor x reflects the increase of the interaction 
rate with growing density due to the finite space requirements of the pedestrians. An 
approximate formula is y = ^ Po/Pmax]", where /t > 1 is a suitable constant 
and pmax is the maximum pedestrian density. Furthermore, 6a is the velocity variance 
of pedestrians belonging to (sub-) population a. Finally, Va > ^-nd > 
represent the average velocities of subpopulations a and h in their desired walking 
directions.) 

We will assume that the probability of moving by Ax in positive (or negative) x- 
dircction, when evading a pedestrian, is inversely proportional to the interaction 
rate at position Xj^ — x-\- Ax (or x^ — x — Ax, respectively): 

llVa{x+) _ IM(X-) 

A first order Taylor expansion of the nominator and the denominator gives the 
following approximate relation for the difference of these probabilities: 

Ax dva{x) 

(which, strictly speaking, is restricted to cases of small gradients dvajdx as in the 
linear regime around the homogeneous solution). Hence, with (6) and (7), we finally 
obtain the following formula for the average velocity of motion perpendicular to the 
desired walking direction: 

dpa , „ dpb^ 



Va{x, t) ^ -C (Ax)' [Caa^ + ^^afe^) ■ (10) 
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Defining Sab = —{^xYCab and generalizing to an arbitrary number A of (sub-) 
populations gives 

Va{x,t)^cY.Sab^. (11) 
b=l 

We may rewrite this in terms of a gradient 

Va{x,t) = c^-^^ (12) 
of the linear density- dependent function 

Sa{x,t)^Sl + Y.SabPb{x,t), (13) 
b 

where the constants do not matter at all. Formula (13) can be interpreted as a 
linear approximation of a more general function Sa{x,t) of the densities. 

Notice that, for higher-dimensional spaces, relation (12) becomes a potential condi- 
tion. Later on, we will see that this is one of the conditions which must be fulfilled 
for optimal self-organization. Since it is not satisfied for pedestrian crowds with 
four different desired walking directions (at intersections), we can now understand 
why, in this case, there exist no optimal self-organized patterns of motion, which 
are stable. Nevertheless, collective patterns of motion like "rotary traffic" can form 
temporarily [47]. 



4 Self-Optimization 

In the following, we will prove that, under certain conditions, the function 

S{t)^J^[ dxpa{x,t)Sa{x,t) (14) 
a '' 

is a Lyapunov function which monotonically increases in the course of time. Notice 
that S{t) can be viewed as being analogous to a thermodynamic non-equilibrium 
potential [53], allowing the determination of the characteristic quantities Sab by 
functional derivatives. For example, if Si,a — Sab, we have 

- 21 ^ • ^^^^ 

By deriving (14) with respect to t, using (13), and properly interchanging indices a 
and b, one can eventually obtain 

dS{t) ^ r dpa{x,t) 



dt 



Ejdx -^^^ Y.iSab + S,a)Pb{x, t) . (16) 



If Sab is antisymmetric (i.e. Si,a = —Sab), S is obviously an invariant of motion. How- 
ever, in the following we will focus on the case Sba = Sab of symmetric interactions. 
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which apphes to our pedestrian, granular, and trail formation examples. Inserting 
(5) and (12) into (16), and applying (13), we get 



dS{t) 
dt 



-2Y.Jdx[Sa{x,t)-S'J^ 



pa{x,t)c 



dSa{x,t) 



dx 



(17) 



Making use of partial integration (for spatially periodic systems) 
at 



dS{t) 
dt 



2^jdx cpa{x,t) 



dSaix,t) 
dx 



> 0. 



we finally arrive 



(18) 



This result establishes self- optimization for symmetical interactions and can be eas- 
ily transferred to discrete spaces (see Section 6 and Fig. 4) and to higher- dimensional 
spaces. In case of slightly asymmetric interactions, small non-linear contributions to 
(13), or small diffusion, relation (18) will still be a good approximation, i.e. the sys- 
tem will behave close to optimal. This is exemplified by heterogeneous freeway traffic 
[35]. Later on, we will see that more or less symmetric interactions are very natural 
for the kind of self-organizing systems we are considering, here (see Section 7). 

Notice that (18) looks similar to dissipation functions in thermodynamics [1, 50-53]. 
If we interpret the function dS(t)/dt as a measure of dissipation per unit time in 
the system, equation (18) immediately implies that the system approaches a station- 
ary state of minimal dissipation, since S{t) is bounded for any finite system (which 
means dS{t)/dt = in the limit of large times t). This may be viewed as a gener- 
alization of the related Onsager principle of minimal dissipation of entropy [51, 52], 
dating back to Lord Rayleigh [50]. In contrast to the non-linear, far- from equilib- 
rium systems considered above, the Onsager principle applies to linearly treatable, 
closc-to-equilibrium systems only, which usually tend to approach a homogeneous 
state. 

According to (18), the stationary solution (x) is characterized by 

dSf{x) dpf{x) 



cp'^i^x) = or 



dx 



b 



dx 







(19) 



for all a, which is fulfilled by homogeneous or by step- wise constant solutions. Hence, 
the stationary solution can he non-homogeneous, hut nevertheless satisfies minimal 
dissipation, which is quite interesting. We would not have recognized this, if we 
would have derived the relations (19) for the stationary solution directly from the 
continuity equation (5) with (12) and (13). 



5 The Relation with Game Theory 

Physicists have recently gained a considerable interest in applications of meth- 
ods from statistical physics and nonlinear dynamics to biological [10-21], economic 
[22-29], and social [29-32,6-9,42] systems. Hence, it is worth stressing that the 
above model can be applied to such kinds of systems, if we give a more general in- 
terpretation to it. First of all, instead of particles or pedestrians, we may have other 
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kinds of entities, which we again need to subdivide into uniform (sub-) populations, 
according to their behaviors. Second, the space may be rather abstract than real, 
for example, a behavioral space or an opinion spectrum [8, 31]. The same applies to 
motion, which may correspond to a change of behavior or opinion. (In the case of 
trail formation, a point x in space even corresponds to a path connecting two places, 
namely a pedestrian source with one of their destinations.) 

Having again a look at the relation (12), it makes sense to interpret the function 
Sa{x,t) as the "(expected) success" per unit time for an entity of population a at 
location x, since it is plausible that the entities move into the direction of the greatest 
increase of success (which is the direction of the gradient). Furthermore, one can give 
a more concrete meaning to the coefficients Sab'- If an entity of kind a interacts with 
entities of kind 6 at a rate Uat and the associated outcome of the interaction can be 
quantified by some "payoff" Pab, we have the relation Sab = ^abPab- Positive payoffs 
Pab belong to attractive or, more general, profitable interactions between populations 
a and b, while negative ones correspond to repulsive or competitive interactions. We 
think, it is quite surprising that, based on competitive interactions, there can be 
self-organized and even optimal system states at all (see Section 7). 

Notice that, despite of the mentioned relations with game theory, our model differs 
from the conventional game dynamical equations [6-8] in several respects: 

1. We have a topology (like in the game of life [44, 45]), but define abstract games 
for interactive motion in space with the possibility of local agglomeration at a 
fixed number of entities in each population. 

2. The payoff does not depend on the variable that the individual entities can 
change (i.e. the spatial coordinate x). 

3. Individuals can only improve their success by redistributing themselves in 
space. 

4. The increase of success is not proportional to the difference with respect to the 
global average of success, but to the local change of success in a population. 

Moreover, below we will establish a new connection between self-optimization and 
self-organization (see Section 7), which we consider to be important. 

6 Self-Organization 

Our generahzed model allows to describe all kinds of different combinations between 
attractive or profitable and repulsive or competitive interactions within and among 
the different populations. It is, therefore, desireable to know the exact conditions un- 
der which the corresponding system forms a self-organized, i.e. a non-homogeneous 
state. In order to derive these, we will carry out a linear stability analysis around the 
homogeneous stationary solution = Na/I, where / again denotes the spatial 
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extension of the system. For simplicity, we will restrict ourselves to the case of two 
(sub-)populations a, 6 e {1, 2}. 



We start with the continuity equation 



dpa ^ d 
dt dx 



PaC 



dSa 



dx 



= cdS^, (20) 



where we have introduced an additional diffusion term with diffusion coefficient c Da 
on the right-hand side, since we will discuss the effect of fluctuations later on. Next, 
we write down the corresponding linearized partial differential equations: 

= -CPa^r-^ +cDa 



dt dx"^ dx"^ 

^^^cp„5„,^ + cD.^. (21) 

Inserting into these equations the ansatz 

p,{x,t)=pl^^ + Pae^'-+'\ (22) 

where k has the meaning of a wave number, leads to the following linear eigenvalue 
problem with eigenvalue A: 

Herein, we have Au = ck'^{p\°'^Sii - Di), A12 = ck'^p\°'^Si2, A^i = ck'^ pl""^ 
and A22 — ck'^{p\°™S22 — D2). The linear system of equations can be solved for the 
two eigenvalues 



An + A22 ^ V(^ll + ^22)' - 4(^11^22 - ^12^l) 

Ai/2 = ^ ± ^ ■ (24j 

In order for the homogeneous solution to be stable, the real values of both eigenvalues 
need to be negative. This requires 

{All + A22) < and (A11A2 - ^12^1) > . (25) 



Notice that, in the case of an unstable eigenvalue, it is the mode with the largest 
wave number (i.e. with the shortest wave length) that grows fastest. This somewhat 
unrealistic behavior is a consequence of simplifications made, namely the linear ap- 
proximation underlying relation (9). In reality, the spatial extension of the entities 
will introduce a natural cutoff for the wave lengths. One may consider this in equa- 
tion (20) by additional spatial derivatives of higher (e.g. fourth) order. However, one 
can easily circumvent these problems by setting up a discrete version of the model 
(where the spatial discretization should be chosen in accordance with Ax). 

The results of Figures 4 and 5, for example, were obtained with the following discrete 
analogue of the model defined by Eqs. (5), (12), and (13). We assumed a periodic 
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lattice with I lattice sites x e {1, . . . , /} and two populations a e {1, 2} with a total 
oi N ^ Ni + N2:$> I entities. (In the figures we used 7 = 40 and ^ N2 ^ 200.) 

At time t = 0, our simulations started with a random initial distribution of the 
entities. Then, we repeatedly applied the following update steps to determine the 
distribution of entities at time t + 1: 

1. Calculate the successes 

Sa(x,t)^S', + ^S,,^, (26) 

b 

where n'^{t) — pb{x,t)I represents the number of entities of population b at 
site X. 

2. For each entity a, determine a random number rja that is uniformly distributed 
in the interval [0, -S'max] with a large constant S^iax (Smax — 20 in the figures). 

3. Move entity a belonging to population a from site x to site x + 1, if 

c{x + l,t)[Sa{x + l,t)-Sa{x-l,t)]>7]a{t), (27) 

but to site X — 1, ii 

C{X - l,t)[Sa{x - l,t) - Sa{x + l,t)] > Va{t) ■ (28) 

(Figure 4 and 5 are for c{x,t) = 1.) In cases, where we assumed errors in the 
estimation of the expected success, we replaced Sa{x,t) by Sa{x,t) + ^a(t), 
where {a(^) is determined according to some probablility distribution. 

We applied a random sequential update rule, which is most reasonable [46]. How- 
ever, a parallel update, which defines a simple cellular automaton [54,55], yields 
qualitatively the same results (even nicer looking ones, because it does not have the 
fluctuations caused by a random update). 



7 Results and Discussion 

Let us first discuss the case Z^^ ~ of negligible diffusion. For this case, the relations 
(25) imply that the homogeneous solution of the model (cf. Figure 4a) is unstable if 

Pi^'^Sn + P2°""S22 > (29) 

or 

'S'l2'S'21 > <S'ii5'22 . (30) 

In other words, if one of the conditions (29) or (30) is fulfilled, the stable stationary 
solution is a self-organized, non-homogeneous state which, according to (19), corre- 
sponds to complete segregation (or aggregation). If the populations interact in a sym- 
metric way, the underlying self-organization process is related to self-optimization 
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(see (18)). Condition (29) is satiesfied by systems in which the interactions within 
the (sub-) populations are attractive or profitable. Such systems show always some 
form of agglomeration (see Figs. 4c and d). 

In the following, we focus on the more common and much more interesting cases 
where (29) is not vahd. This will allow us to answer the question, why self-organizing 
systems of the considered type tend to reach an optimal state. The solution is: 
"because they tend to be symmetric!". This can be seen as follows: Introducing 

S = ^ll±^ and AS^ ^''~^'\ (31) 

we have 

Si2^S + AS and 821^8 -AS, (32) 
and condition (30) becomes 

(S + AS) (S - AS) =S^ - (AS)^ > SnS22 ■ (33) 

Since the interaction strengths IS*!!!, 1 5*221, 1 5121, |52i|, and j^l will normally have 
the same order of magnitude, this condition for self-organization can only be fulfilled 
for small |A5|, i.e. 

5i2 ^ 521 . (34) 

Hence, there is a tight connection between self-organization and self-optimization 
in the considered kinds of systems: // there is self- organization, it is likely to come 
with optimality, at least approximately. For this reason, one may speak of a "self- 
organized system with optimality" or more compact of "self-organized optimality" 
(although there is no immediate relation with "self-organized criticality" [56]). How- 
ever, the more precise term is probably "optimal self-organization" A good exam- 
ple is uni-directional multi-lane traffic of cars and trucks [35], which develops a 
self-organized, coherent state only in a small density range, which is also character- 
ized by minimal interactions (minimal lane-changing and interaction rates). From 
the above, we conclude that, only in this density range, the interactions of cars 
and trucks become sufficiently symmetric to give rise to self-organization and self- 
optimization. This conclusion is quite reasonable, since, according to the assumed 
traffic model, the interactions of cars and trucks are more symmetric when their 
average velocities are similar. 

In our pedestrian example, we find optimal self-organization, since the symmetry 
condition is satisfied exactly, and condition (30) is also fulfilled (see Eq. (7) and 
below). Note, however, that there are many other examples of segregation in the 
natural and social sciences [34, 57-59, 29]. We point out that the spatial regions oc- 
cupied by one population need not be connected (cf. Figures 4b to 4d), and that the 
corresponding configuration may correspond to a relative optimum as in Figures 4c 
and 4d. If Saa < for all a, the distributions pj(x) tend to be flat, as in the case 
of lane formation by repulsive pedestrian interactions (Figure 4b). Instead, we have 
agglomeration (local clustering), if Saa > for all a (Figures 4c and 4d). Figure 

^This implies that there are also "non-optimal" forms of self-organization like in systems for 
which no Lyapunov function exists. A typical example are systems with oscillating or chaotic states. 
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4c describes the segregation of populations with repulsive interactions (e.g. "ghetto 
formation"). The case of Figure 4d allows to understand the conjectured optimahty 
of trail systems which, based on attractive interactions, result by a bundling of trails 
ending at different destinations [36]. 

Finally, we discuss the influence of fluctuations. Including the effect of diffusion, the 
conditions for self-organization will become 

Pa^'^Saa + pl^'^Shb > + D, (35) 

or 

Hence, large diffusion coefficients will produce homogeneous equilibrium states, and 
the principle (18) of self-optimization is not valid anymore (see Figure 4e).^ However, 
small diffusion can further self- organization. Not only will the system be able to 
escape relative optima and eventually reach the global optimum (cf. Figures 4f and 
5), although the interactions are short-ranged (see Eq. (12)). According to (36), 
small diffusion can also reduce the stability of the homogeneous stationary solution, 
which is quite surprising. 



8 Summary and Outlook 

Our investigations were motivated by the question why many self-organized systems 
seem to optimize certain macrosopic quantities, for which we have given a number of 
realistic examples. In order to explain this, we have derived macroscopic equations 
for lane formation in systems of oppositely moving driven particles or pedestrians. 
We could show that, in cases of repulsive interactions, the system tends to mini- 
mize the interaction rate and the intensity of interactions. The applicability of the 
model, however, could be extended to cases of attractive interactions and, using 
game theoretical ideas, also to competitive or profitable interactions in many kinds 
of non-physical systems like biological, economic, or social ones. 

After having shown that many driven systems can be represented as a game between 
interacting (sub-)populations, we have constructed a functional for such systems, 
which is related to thermodynamic non-equilibrium potentials and can be inter- 
preted as overall (expected) success. In cases of symmetric interactions among the 
populations, this function increases monotonically in the course of time, meaning 
that the overall success of these systems is optimized. In other words, as individual 
entities are trying to maximize their own success, these systems tend to reach a state 
with the highest global success, which is not trivial at all. Since the form of the in- 
creasing function reminds of a generalized thermodynamic dissipation function, one 
can also say that the system approaches a state of minimal dissipation (which may 
be considered as a generalized Onsager principle) . This principle of "minimal waste 

^For example, lane formation in streams of oppositely moving particles can be suppressed by 
sufficiently strong fluctuations, giving rise to "frozen" (blocked) states [48] . 
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of energy" may be particularly interesting for biology, where it can be conjectured 
that organisms use energy very efficient. For example, it is known that pedestrians 
tend to move at the speed which is least energy consuming [60]. Wc think it is worth 
pointing out that there are quite a number of living systems (for which we have 
given some realistic examples) to which existing methods and notions from thermo- 
dynamics can be successfully applied, if they are generalized in a suitable way. It 
would be surely interesting to look for other systems, for which similar results or 
principles can be found. 

Here, we obtained that the precondition for self-organization with self-optimization 
is symmetric interactions. However, we could give arguments indicating that the 
considered systems, if they self- organize at all, are also (more or less) symmetric 
and, hence, behave (close to) optimal. Therefore, the phenomenon of "self-organized 
optimality" or "optimal self-organization", as we call it, is expected to be quite 
common in nature. Already for two symmetrically interacting populations, one can 
classify more than ten different situations (dependent on whether Su, S22, and 
5'i2 = 5*21 are smaller or greater than zero, and whether conditions (29) or (30) 
are fulfilled or not). This includes quite surprising cases as for repulsive interactions 
within each population and stronger attractive interactions between them (e.g. = 
'S'22 = —1, 'S'12 = 5*21 = 2), which leads to agglomeration analogous to Figure 4d 
rather than homogeneously distributed, mixed populations as in Figure 4a. Apart 
from the results displayed in Figure 4, there are also cases where one population 
agglomerates, but the other one is distributed homogeneously (if we choose 5*11 
different from 6*22). In systems with diffusion, the variety of different cases covered 
by the above approach is even greater. In particular, we have observed that, while 
large noise generally destroys self-organized solutions, small noise can further self- 
organization in the considered systems, which is surprising. 

Finally, we point out that our results are relevant for practical applications. For 
example, when optimizing multi-agent systems (like the coordination of vehicle or 
air traffic, or the usage of CPU time in computer networks), it is desireable to apply 
control strategies that are insensitive to system failures (like the temporary break- 
down of a control center). Hence, it would be favourable if the system would optimize 
its state by means of the interactions in the system. For this, one needs to imple- 
ment a suitable type of interactions (namely, symmetric ones) , which can be reached 
by technical means (intelligent communication devices determining the proper ac- 
tions of the interacting entities). Notice that this kind of multi- agent optimization 
is decentralized and, therefore, much more robust than classical, centralized control 
approaches. 
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Figure 1: Formation of lanes of uniform walking 
directions in crowds of oppositely moving pedestri- 
ans. Red circles represent pedestrians walking up 
the street, blue ones move downwards. The simula- 
tion assumed periodic boundary conditions, but we 
could also use walls on both sides or randomly feed 
pedestrians into the upper and lower boundaries 
of the simulation area, without destroying the ef- 
fect of lane formation. (To see this, you may check 
out the Java applets supplied on this internet site: 
http : //www . theo2 . physik . uni-stuttgart . de/ 
helbing.html) 
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Figure 2: Simulation results for a uni-directional two-lane freeway used by two differ- 
ent vehicle types, cars and trucks. We assume that fast vehicles overtake slow ones, 
if possible and safe. In addition, cars tend to drive with their respective "optimal 
(safe) velocity" (red squares), which depends on the local vehicle density (the inverse 
distance to the next vehicle ahead). The same applies to trucks, but with a consid- 
erably smaller optimal velocity (blue squares). (For details see Ref. [35].) According 
to our simulations, traffic flow is stable up to densities of about 24 vehicles per 
kilometer and lane, while stop-and-go traffic develops at higher densities, a Between 
about 22.5 and 24 vehicles per kilometer and lane, the difference (green line) between 
the average velocities of cars (red line) and trucks (blue line) becomes almost zero, 
which is a consequence of the breakdown of the lane changing rate (see b). Hence, 
a coherent state of motion appears only in a small density range which, at the same 
time, is characterized by a minimal interaction rate and a minimal overtaking rate. 
Hence, self-organization (coherent motion) and optimality (minimal interaction) are 
directly related in this example. 
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Figure 3: Schematic representation of a human trail system (sohd hues) evolving 
between four entry points and destinations (full circles) on an initially homogeneous 
ground [36]. When the frequency of trail usage is small, the direct way system 
(consisting of the four ways along the edges and the two diagonal connections) is 
too long to be maintained in competition with the regeneration of the vegetation. 
Here, by bundling of trails, the frequency of usage becomes large enough to support 
the depicted trail system. It corresponds to the optimal compromise between the 
diagonal ways and the ways along the edges, supplying maximum walking comfort 
at a minimal detour of 22% for everyone. In this example, it is the discomfort of 
walking multiplied by the length of the individual ways that is minimized. 
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Figure 4: Illustration of various forms of self-optimization for two different popula- 
tions: a Homogeneous distribution in space, b segregation of populations without 
agglomeration, c repulsive agglomeration, d attractive agglomeration. Cases b to 
d are examples of "optimal self-organization" or "self-organized optimality" , since 
the finally evolving optimal states are self-organized, non-homogeneous states. In 
contrast to the results displayed in a to d, in e and f we have additionally intro- 
duced fluctuations corresponding to errors in the estimation of success Sa{x, t). Large 
fluctuations destroy the tendency of self-optimization and produce a homogeneous 
distribution of entities (see e), whereas small fluctuations help to escape relative 
("local") optima, leading to a continuation of the agglomeration process until the 
absolute ("global") optimum is reached (see Figure 5). 

The above figures show the numbers and Ux = (n^ -|- n^) of entities as a function 
of the lattice site x at time t — 4000 (in f:t — 40000) and the evolution of the 
overall success S{t) as a function of time t. The fluctuations around the monotonic 
increase of S{t) in a to d are caused by the fluctuations rja (see Eqs. (27), (28)) and 
the random sequential update. 
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Figure 5: Illustration of the temporal evolution of the distribution of the number 
of entities over the lattice sites related to the simulation displayed in Figure 4f. 
During the first few thousand time steps (not displayed), the small fluctuations 
play a sub dominant role, and the entities agglomerate around several lattice sites 
due to the assumed attractive interactions among the entities, similar to Figure 4d. 
The clusters resulting in this first dynamic stage are more distant from each other 
than the range of interaction. Hence, their merging at later times is mainly due to 
fluctuations. The fluctuations of the individual entities around the centers of the 
clusters, which originate from errors in the estimation of success, can sum up and 
cause a slow variation of the centers of the clusters themselves (see above). In this 
way, initially distant clusters can accidentally come close to each other in the course 
of time, and merge. This is related with "evolutionary jumps" in the overall expected 
success (see Figure 4f) (which may be compared to "synergy effects" connected with 
the fusion of companies). 



